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Abstract. - We study the dynamics of a dilute spherical model with two body interactions 
and random exchanges. We analyze the Langevin equations and we introduce a functional 
variational method to study generic dilute disordered models. A crossover temperature replaces 
the dynamic transition of the fully-connected limit. There are two asymptotic regimes, one 
\Q | determined by the central band of the spectral density of the interactions and a slower one 

, determined by localized configurations on sites with high connectivity. We confront the behavior 

f^) ' of this model to the one of real glasses. 

(N 
O 

Kirkpatrick, Thirumalai and Wolynes showed that a family of fully connected (fc) disor- 
dered spin systems realize schematically the phenomenology of the glass transition pQ. These 
i-^j ■ models are very useful for several reasons: (i) their statics and dynamics are solvable with 
a variety of techniques; (ii) since their macroscopic dynamic equations are identical to those 
O ■ stemming from self-consistent approximations to more realistic interacting systems (e.g. modc- 
J - } ' coupling (mca) [2]) they limit the range of validity of the latter; (iii) their defects are clear (fc, 
infinite dimensions) and some improvements needed in a better description of real systems can 
be identified. The FC p spin disordered models are members of this group. Models of finite 
dimensional manifolds embedded in infinite dimensions under quenched random potentials are 
generalizations that also yield real space information 0. 

The main features of the FC spherical p spin model, on which we focus for concreteness, 
are the following, (i) It has a dynamic transition at Td < +oo. Above Td an infinite system 
(N — > oo) equilibrates with its environment pQ. Below Td the equilibration time diverges with 
N pQ. Right above Td the dynamics coincides pQ with the schematic MCA to super cooled 
liquids and correlations decay in two steps. Below Td for any waiting-time t w two-time 
functions decay to zero after a sufficiently long subsequent time, with aging effects [2]. (ii) 
It has a rich structure of metastable (tap) states that are stationary points of a free-energy 
density / function of the relevant order parameters (m, = (sj) in this case) jSJEj. Within 
(fmin, fth] the number of metastable states, M(f), is exponential in N leading to a finite 
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complexity S(/) = N^ 1 hij\f(f). (/ m , n < /t^ when p > 3.) Strictly below /j^ minima are 
exponentially dominant with respect to saddles. Typically the states on the threshold (th) 
are marginal jS] and attract the dynamics when times diverge after N — > oo 0J|7|. (iii) At 
Td the liquid state (m, = OVi) is fractured into an exponential in N number of TAP states 
with rrii =/= 0. At T s the partition sum is dominated by the lowest states with f m in — feq 
and, since £(/mm) = 0, there is an entropy crisis associated to the Kauzmann paradox pQ. 
(iv) The barriers between TAP states are expected to be O(N) leading to a separation in the 
time-scales to descend below the threshold. 

In finite dimensional systems with finite range interactions, however, the dynamic tran- 
sition is only a crossover at T g and it is not clear if the static transition exists at all. The 
dynamics must penetrate below the threshold to slowly descend towards equilibrium. Within 
this picture two distinct regimes would appear in the low-T isothermal dynamics of real sys- 
tems: a FC-like one when the system approaches a pseudo-threshold of flat directions in phase 
space and a slower activated regime in which the system jumps over barriers to relax its ex- 
cess energy density and very slowly progress towards equilibrium 0. This view explains the 
cooling-rate effects since crossing T g with a slower rate allows to penetrate deeper below the 
threshold. How and if the aging properties in the first and second regime resemble is a very 
interesting open problem. One could attack it analytically by studying the dynamics of p 
spin models in time scales that diverge with N though this is very hard. Simulations of finite 
size FC models and Lennard- Jones mixtures support the existence of the two aging 

regimes. 

In this Letter we study an alternative model that realizes explicitly two nonequilibrium dy- 
namic regimes, a FC-like one and a slower one that we relate to transitions between metastable 
states with finite life-time. The merits of the model are manifold. Its dynamics is tractable 
analytically. Being defined on a random graph the time-scale dependent metastable states 
are determined by the "real space geometry" : they are localized configurations on sites with 
high connectivity. The model has also some drawbacks that we discuss after presenting its 
solution. Still, we expect to use it as a starting point for the study of more realistic cases. 

We solve the dynamics of the dilute spherical model: 

Hj[s\ = -\^J lj s i s j . (1) 

where the spins are continuous unbounded variables, spherically constrained X^ili s l = N . 
The couplings are quenched random variables, independently and identically distributed 
with 

P(Jij) = (1-p/N) SiJ^+p/NniJij), 

*(Jii) = \ Wii - VVp) + 5{Jij + i/Vp)} , (2) 

that satisfy J a = and Jij = Jji. When p is finite and N goes to infinity, this distribution 
law generates a random graph, so that the connectivity of a given site is distributed according 
to a Poisson law with average p. Contrary to the FC case, i.e. the complete graph obtained in 
the p — N — > oo limit, each spin interacts with a finite number of "neighbors", as in a finite 
dimensional system. Yet, the "neighbors" are chosen randomly among the other spins and 
there is no geometrical distance. The model is of mean-field type. In all the following we take 
p ^> 1 but finite with respects to N. The spins evolve with the Langevin equation 



Si(t) = -SHj[s\/Ssi(t) - z{t) Sl (t) + 



(3) 
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where the Lagrange multiplier z{t) enforces the spherical constraint and £i(t) is a white noise 
with zero mean and variance (£i(t)£j(t w )) — 2TSijS(t — t w ). (kg — 1 and we rescaled time to 
absorb the friction coefficient.) 

We solve the model in two ways. By rotating the spin s — (si, . . . , sn) onto the basis of 
eigenvectors of the random matrix Jy the Langevin equations of any continuous quadratic 
model decouple and can be completely solved |11II12| . Many interesting dynamic observables 
depend only on the density of states p(/x) of the interaction matrix J^-. We estimate their 
scaling in different regimes analytically and we confront them to the numerical solution of the 
dynamical equations where we approximate pip) with Eq. (29) in |13| . Then we introduce 
a more general method that can also be applied to non-quadratic models and/or soft spins. 
It is a dynamic generalization of the iterative method used to find pip) for dilute random 
matrices |14j . 

For future reference, let us summarize the main properties of pip) (151113) . It has a 
symmetric central band in [— \ c (p), A c (p)], a crossover extending beyond |A c (p)| that is not 
known in detail, and two tails that vanish as pip) ~ exp[— pp 2 ln/i 2 ] when p — > ±oo. The 
tails are due to large fluctuations of the local connectivity. For k ^> 2p a site with k neighbors 
gives rise to an eigenvalue p ~ \fkjp with a localized eigenvector on it. When p — > oo, 
A c (p) — * 2 and the tails disappear. 

At time t after preparation in the initial condition s M (0) the rotated spin s M (t) = ■ s(t) 
is given by 

s M (t)v/f(t) = ^(O)e^ + / <tfePW>y/r(fjMt) ■ 

Jo 

r(t) = exp[2 J*dt'z(t')} is related to the energy density, e(t) = T/2 - d t \nT(t)/A, and it 
determines the decay of the self-correlation NC(t,t w ) — J2iLi[( s i(t) s i(tw))]j and linear self- 
response NR{t,t w ) — Yli=i ^[( s i(0)] j/8hi(t w )\h=o- We choose the initial condition s^(0) = 
±1 V/Lt that mimics an instantaneous quench from T = +oo at t — 0. Imposing the spherical 
constraint C(t,t) = J dpp(p)(sf l (t)) — 1 implies 

r(t) = f(t) + 2T f dt' f(t - t>)T(t>) , (4) 
Jo 

with fit) = f dp pip)e 2fJ,t . Asymptotically fit) can be estimated with a saddle-point eval- 
uation of the integral. When it is dominated by p ~ A c (p), as in the FC limit, fit) ~ 
exp[2A c (p)t]/i 3 / 2 . After a crossover time t® ip) the integral is dominated by p's in the crossover 
in pip) and fit) grows faster than an exponential though we cannot determine its functional 
form. Finally, when times are so long as to explore the tails of pip), fit) ~ exp[t 2 /(2plnt)]. 

We thus have a first crossover time t° co ip) where the behavior of / changes from exponential 
(with polynomial corrections) to faster than exponential. The more interesting function r(t) 
is determined from fit) by Eq. Q. Note that at T = 0, these two functions coincide. When 
T is raised to a positive value, r(i) has still a crossover time t co (T,p) beyond which it grows 
faster than exponential. The important feature which comes out of Eq. (@J is that t co iT,p) 
remains close to t® (p), its zero temperature value, until a crossover temperature Tq(j>) is 
reached. For higher temperatures t co iT,p) grows with T. These time-temperature regimes 
are sketched in the left panel of Fig. ^ More quantitatively, this behavior amounts to: 

- when T < T ip): Tit) ~ /(t)/(l - T/T (p)) 2 for 1 < t < t° co ip) and r(t) - fit) for 
t»t°,(p). 

- when T > T (p): Tit) - exp[6(T)i] for 1< t < t c0 (T,p) and T(t) - fit) for f > * co (T,p) 
with t co iT,p) a growing function of T. 
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Fig. 1 - Left: the crossover time as a function of temperature. Solid line p = pi, dashed line p — P2- 
pi < p2. Right: Decay of the energy-density, p = 10. From bottom to top: T — 0, T = 0.5, T = 1.3 
and T = 1.7. 

Tq(p) is the trace of the phase transition in the FC limit (Tb(oo) = 1). It separates a low 
T regime in which the model has a FC-like out of equilibrium decay for long time-scales and 
a much slower one for still later epochs, from a high T regime where the system crosses over 
from an equilibrium-like behavior at long time-scales to the tail dominated very slow out of 
equilibrium decay at much longer time-scales. For all T the system eventually reaches the tail- 
dominated regime but the higher the temperature (> Tb(p)) the longer the equilibrium-like 
regime lasts. 

The time-scales just described can also be visualized from the decay of e(i) displayed in 
the right panel in Fig. ^ For the two lower curves T < Tq(p) ~ 1.1 and t° co (p) ~ 35. The 
plateau occurs at [T — X c (p)]/2 as in the FC limit. For the two upper curves T > Tq(p) and 
t co (T,p) increases with T. For all T, when t 7$> t co (T,p), we have e(t) ~ — t/(Aphxt) meaning 
that the energy density diverges asymptotically, a result that is consistent with an unbounded 
p(fi) . The dynamics in the tail-dominated regime is independent of T, so not activated. 

We explain in this paragraph how these results can be viewed as a sketchy picture of a 
glass "transition" , see the left panel of Fig. Imagine that experimentally one has access 
to times that are shorter than t exp , choose a value of p such that t° co (p) < t exp and define 
T* by t exp = t co {T* ,p). T* thus depends on the experimental time-scale available, and is 
larger than To(p). When T < To(p) and times are shorter than t° co {p) the system ages as in 
the FC limit while beyond t® a (p) aging is of a different kind, dominated by the tails of the 
distribution. When T > T* all accessible times are shorter than t co (T,p) and the dynamics 
is stationary as in the high-T phase of the FC limit. (Note however that these results are not 
accessible with a naive static calculation since e is not bounded from below.) Finally, there 
is an intermediate temperature regime, Tq(p) < T < T* in which the dynamics crosses over 
from stationary to tail dominated. The width of this "unnatural" regime can be shrinked by 
using larger p's since T (p) very weakly decreases with p while t° co {p) grows with p, cfr. the 
two curves in the left panel of Fig. One concludes that the dynamics behaves similarly to 
what expected in real glasses in the sense that within the experimentally limited time-window 
there are two aging regimes when T < To(p) and a single stationary regime at high T. 

From now on, in order to shorten the notation we call To the crossover temperature and t co 
the crossover time at the considered T and p, i.e. t co — t° co {p) if T < To(p) and t co — t co (T,p) 
if T > Tq(p). When p — > oo, t co moves to infinity for all T, p(/i) approaches the semi-circle 
law and T(t) takes the FC form. 

The evolution in the FC limit was easy to grasp by following (s M (i)) where the low-T 
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non-equilibrium dynamics corresponds to an incomplete condensation on /i = 2 12]. Let us 
focus on T < To and analyze (s M (t)) in the dilute case. When t is in the FC-like regime, 
the projections on all eigenvectors with \i < X c {p) are exponentially suppressed, the one 
with /i = X c {p) increases as a power law in time and the ones with /i > X c {p) increase 
exponentially in time. When t enters the tail-dominated regime, the cut-off /i c (i) which 
separates the eigenvectors that are exponentially suppressed [fi < fJ. c (t)] from those that 
increase exponentially [fx > /-i c (t)] moves away from \ c (p) and eventually grows as fi c (t) ~ 
t/{Aphxt). In real space this means that localized states on all sites with connectivities (k > 
P(J%) increase exponentially for times < £(/x c ) while all others are exponentially suppressed. 
At longer times sites with higher connectivities dominate. 

Richer information about the nonequilibrium evolution is contained in the self-correlation, 
C, and linear self-response R |2B3]- An expression for C in terms of T that is also valid for the 
dilute model is given by Eq. (2.12) in • We identify several scalings. When t and t w are 
long but shorter than t co the dynamics resembles the one for the FC model. For T > T the 
decay is stationary. For T < T instead there is a first stationary decay towards an Edwards- 
Anderson plateau qEA — 1 — T/Tq when r = t — t w <C t w and a subsequent aging decay from 
qEA towards zero with simple aging scaling, C(t,t w ) ~ C(t w /t), when t w oc t. Instead, when 
t w falls in the tail-dominated regime T(t) ~ f(t) and 

cr(t)t - ) -> exp (~^:) 

when t w — > oo and t <^i\nt w . At T — we immediately identify the effective time r e // ~ 
t w and a very slow subaging decay |18j . One can recast the correlation in the more familiar 
form 

C{t ^ = exp (-^) • * = m ' fcW = exp ivm) ■ (6) 

If r <C \/ln t w /t w we get C ~ 1 — Tr. The duration of the t w independent part of the decay 
decreases with t w and eventually disappears. Thus, the finite-T corrections vanish for long t w 
and the scaling © holds for all T. These features are shown in Fig. [21 

The linear self-response is given by R(t,t w ) = y / T(t w )/T(t)f(T/2). When t < t co the FC 
scaling holds. When t w t co and for r oc \/ln t w when C varies, R(t, t w ) = exp[— rt w / (2phat w )] 
R decays much faster than C, it approaches zero on the scale r ~ \n.t w /t w . An equivalent 
expression for this result is R(t,t w ) ~ exp[(— hix)t w /^/phit w \ with x given in Eq. 

The modification of the fluctuation-dissipation theorem (fdt) is different in the two non- 
equilibrium regimes. In the FC-like scale the results are identical to those in ^2] and the 
effective temperature jE] T e ff = d tvj C / R diverges as \ft^. In the tail-dominated scale T e ff 
diverges much faster, as T e ff[C] ~ exp[a(C)t w / \/p\n t w ] with a(C) = y (—2 InC). The inset 
in Fig. |21 shows the parametric plot of the integrated response x against C [3] when t w is in 
the latter regime. 

We solved (01 in a rather simple way thanks to the quadratic nature of the model. Unfor- 
tunately, this calculation cannot be adapted to treat cases with higher order interactions as 
are models with soft spins. With the purpose of developing a more generic approach to the 
dynamics of dilute models we introduce a method to derive macroscopic equations for C and 
R from the dynamic generating functional Z^. We only sketch the method here, the details 
shall be given in a forthcoming publication 17 . The idea is to take benefit of the formal 
analogy between the static replica free energy and the dynamical action expressed with a 
supersymmetric (SUSY) formalism. Using the SUSY formulation of stochastic processes ^SJ 



2T / dy exp 
'o 



ytw 
pint,, 



(5) 
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the two-point functions are encoded in a correlator NQ(a,b) — YliLi [(^»( a )^*(&))] J between 
two superfields $j(a). a and b include time and two Grassmann coordinates 9,9. We define 
the fraction of sites with super-field <&i identical to a chosen value <E> for all coordinates, in 
analogy with the replica order parameter for dilute systems 20 , 



/v 



(7) 



i— 1 a 



After introducing it in Zd and averaging over disorder |17| we obtain the saddle-point equation 

SHeff 



c sp (<i>) = A exp 



-\ f da$(a) (- D W + z(aj) $(o) - 



5c($) 



(8) 



with A a normalization constant, Da a differential operator, J da the integration over time 
and Grassmann coordinates, and 



exp(-7ViJ, 



eff) 



exp 



da Hj[$i(a)] 



This equation determines c[<&] for any model for which the saddle-point evaluation is exact. 
(For models without spherical constraint, one removes the Lagrange multiplier z(aj). It plays 
the role of Eq. (20) in f° r the replica order parameter c sp ((f>) introduced to compute 
p(n). It cannot be solved without assumptions, yet an iterative resolution similar to that 
of |14U13| taking into account more and more precisely the fluctuations in the local geometry 
of the interactions can be implemented. For the present model one recovers the same results 
obtained in this Letter ^7]. We expect that this approach will also be successful for non- 
quadratic models for which an exact resolution is not possible. 

In short, we showed that the dilute spherical spin-glass realizes explicitly part of the 
scenario expected to hold beyond the "mean-field picture" of glassy dynamics. The main 
ingredient of the model is the unbounded distribution of local connectivities, regardless of 
the sign of the interactions. In the glassy context this model has, however, some flaws. Its 
equilibrium energy density is not bounded and, strictly speaking, it only has a low-T phase. 
The dynamics in late epochs does not depend on T and when T is close but above To the 
stationary correlations do not decay in two steps. Nevertheless, the existence of a dynamic 
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crossover around Tq as opposed to a phase transition and the presence of two nonequilibrium 
regimes are expected features for real glasses. 

Dilute magnets are important in several other contexts. They are prototypical models 
with Griffiths phases and heterogenous dynamics [22] • They are also related to sev- 
eral optimization problems, and their dynamics to that of optimization algorithms |28| . We 
shall report on studies of the dynamics of other dilute models, hopefully free of the defects 
mentioned above, in the future. 

* * * 
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